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COMPARISON OF HIERARCHICAL STRUCTURES 
AND MERGING OF DIFFERENCES 



BACKGROUND OF THE INVENTION 
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The present invention is a tool which compares two 
hierarchical data structures and produces a third 
hierarchical data structure indicating the differences 
between the two input data structures. The user may then 
traverse the third data structure and select the nodes of 
interest to create a new fourth data structure comprising 
components selected from the first and second data 
structures, based upon the differences highlighted in the 
third data structure. The preferred embodiment of the 
present invention provides this facility for XML files. 



Data is often modeled using structures based upon 
hierarchy. For example, an XML (Extensible Markup 
Language) document has a tree hierarchy with the nodes 
being the element tags in the document. When changes are 
made between versions of an XML document/ one may want to 
understand what the changes were. Also, in a multi-user 
environment, it is desirable to be able to merge multiple 
changes to a single document in a controlled manner. 
Current tools which provide difference comparisons 
between files at the source level (e.g.* UNIX diff) do not 
recognize the context of a hierarchy. Typically, they 
simply match strings within flat ASCII fiies. 

Thus, there is a need for a software tool that will 
compare differences between hierarchical structures and 
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provide the user with the ability to reconcile and 
understand the differences, and select which differences 
should be merged into the controlled base set of 
documents . 

SUMMARY OF THE INVENTION 

The present invention provides a method for identifying 
to a user, the differences between elements of two 
hierarchically structured files, comprising the steps of 
comparing the elements of a base file to the elements of 
a modified file; providing to the user a tree structure, 
said tree structure combining the elements of said base 
and said modified files; and highlighting the differences 
between said elements of said base and said modified 
files. 

The method may further comprise the step of allowing the 
user to resolve said differences between elements, 
thereby creating a merged file . containing elements from 
said base file and elements from said modified file. Said 
step of allowing the user to resolve said. differences may 
include indicating to the user differences between 
elements by one of the identifiers: new, changed or 
removed. For an element identified as new, the method may 
provide the user with the following options: do not use 
the new. element, whereby the new element is not 
incorporated into said merged file; and use the new 
element, whereby the new element and children thereof, if 
any, are incorporated into said merged file. The method 
may also include, for an element identified as changed, 
providing the user with the following options: use old, 
where conflict, whereby for the merged file the changed 
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element is taken from the base file together with 
unresolved children thereof, if any; and use new, where 
conflict, whereby for the merged file the changed element 
is taken from the modified file together with unresolved 
children thereof, if any. And, for an element identified 
as removed, the method may also provide the user with the 
following options: do not delete, whereby the merged file 
has the element as it exists in the base file; and delete 
from the base file, whereby the merged file does not have 
the element that was deleted from the base file. 

The method may also comprise visually displaying the tree 
structure. The visually displaying of the tree structure 
may also comprise displaying to the user a screen 
containing three panes, the first pane displaying said 
tree structure, the second pane displaying an element of 
said base file, and the third pane displaying an element 
of the modified file. Further, the method may include, 
when the user selects an element of the tree structure 
displaying in the first pane, displaying the source code 
for the selected element: in the second pane if the 
selected element exists in the base file; and in the 
third pane if the selected element exists in the modified 
file. 

Further, the step of comparing may use an ID attribute of 
the elements of the base file and the modified file being 
compared. The step of comparing may also use a name 
attribute of the elements of the base file and the 
modified file being compared. Further, the step of 
comparing may use, when the hierarchically structured 
files are XML (extensible markup language) files, if 
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provided by the elements of the base and. modified files 
being compared, an attribute of type ID, or if an 
attribute of type ID is not provided by the elements of 
the base and modified files being compared, a <Uuid> tag 
if provided by the elements of the base and modified 
files being compared, or if an attribute of type ID and a 
<Uuid> tag is not provided by the elements of the base 
and modified files being compared, a name attribute if 
provided by the elements of the base and modified files 
being compared, or if an attribute of type ID, a <Uuid> 
tag and a name attribute is not provided by the elements 
of the base and modified files being compared, a 
concatenation of a tag of the element and a value of the 
element . 

The hierarchically structured files of the method may be 
XML (extensible Markup Language) files. 

There is also provided a method for visually identifying 
to a user, the differences between elements of a 
hierarchical base data structure and a hierarchical 
modified data structure, comprising the steps of: 
comparing the elements of said base data .structure to the 
elements of said modified data structure; displaying to 
the user a tree structure, said tree structure combining 
the elements of said base and modified data structures; 
and highlighting the differences between said elements of 
said base and modified data structures. 

There is also provided a program storage device readable 
by a data processing system, tangibly embodying a program 
of instructions, executable by said data processing 
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system to perform the method steps of any of the 
foregoing method steps. 

The present invention also provides a system for 
identifying to a user, the differences between elements 
of two hierarchically structured files, comprising means 
for comparing the elements of a base file to the elements 
of a modified file; means for providing to the user a 
tree structure, said tree structure combining the 
elements of said base and said modified files; and means 
for highlighting the differences between said elements of 
said base and said modified files. 

The system may further comprise means for allowing the 
user to resolve said differences between elements, 
thereby creating a merged file containing. elements from 
said base file and elements from said modified file. Said 
means for allowing the user to resolve said differences 
may include means for indicating to the user differences 
between elements by one of the identifiers: new, changed 
or removed. For an element identified as new, the system 
may provide means for providing the user with the 
following options: do not use the new element, whereby 
the new element is not incorporated into said merged 
file; and use the new element, whereby the new element 
and children thereof, if any, are incorporated into said 
merged file. The system may also include, for an element 
identified as changed, means for providing the user with 
the following options: use old, where conflict, whereby 
for the merged file the changed element is taken from the 
base file together with unresolved children thereof, if 
any; and use new, where conflict, whereby for the merged 
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file the changed element is taken from the modified file 
together with unresolved children thereof, if any. And, 
for an element identified as removed, the, system may also 
include means for providing the user with the following 
options: do not delete, whereby the merged file has the 
element as it exists in the base file; and delete from 
the base file, whereby the merged file does not have the 
element that was deleted from the base file. 

The system may also comprise means for visually 
displaying the tree structure. The means for visually 
displaying of the tree structure may also means for 
displaying to the user a screen containing three panes, 
the first pane displaying said tree structure, the second 
pane displaying an element of said base file, and the 
third pane displaying an element of the modified file. 
Further, the system may include, when the user selects an 
element of the tree structure displaying in the first 
pane, means for displaying the source code for the 
selected element: in the second pane if the selected 
element exists in the base file; and in the third pane if 
the selected element exists in the modified file. 

Further, the means for comparing may use an ID attribute 
of the elements of the base file and the modified file 
being compared. The means for comparing may also use a 
name attribute of the elements of the base file and the 
modified file being compared. Further, the means for 
comparing may use, when the hierarchically structured 
files are XML (extensible markup language) files, if 
provided by the elements of the base and modified files 
being compared, an attribute of type ID, or if an 
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attribute of type ID is not provided by the elements of 
the base and modified files being compared, a <Uuid> tag 
if provided by the elements of the base and modified 
files being compared, or if an attribute of type ID and a 
<Uuid> tag is not provided by the elements of the base 
and modified files being compared, a name attribute if 
provided by the elements of the base and modified files 
being compared, or if an attribute of type ID, a <Uuid> 
tag and a name attribute is not provided by the elements 
of the base and modified files being compared, a 
concatenation of a tag of the element and a value of the 
element . 

There is also provided a system for determining the 
differences between two hierarchically structured files 
comprising a parser to parse the files and produce a 
parse tree output for each file; a comparison module to 
compare the parse trees output from the parser and to 
create a merged tree from the parse tree outputs; and a 
tree view module to display the merged tree. 

Also, a hierarchical data structure for use by a computer 
system and stored on a computer- readable storage medium 
is provided, said structure comprising a * plurality of 
nodes; each of said nodes corresponding to a hierarchical 
element contained within a base file or a modified file, 
said files stored within said computer system; and each 
of said nodes having an indicator if said node is new, 
changed or removed when comparing the nodes of said base 
file to said modified file. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the present invention will now 
be described, by way of example only, with reference to 
the accompanying drawings in which: 

Figure 1 is a schematic diagram illustrating a base file 
structure tree and a modified file structure tree; 

Figure 2 is a schematic diagram illustrating the merged 
file structure tree resulting from the merging of the two 
structures represented in Figure 1; 

Figure 3 is a screen capture of a user interface 
illustrating the merged file structure tree of Figure 2, 
as well as portions of the base file structure tree and 
modified file structure tree of Figure 1; and 

Figure 4 is a schematic diagram illustrating the 
components of a preferred embodiment of. the present 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS OF THE INVENTION 

A preferred embodiment of the present invention will be 
discussed in the context of how it is able to compare and 
merge XML documents. As can be appreciated by those 
skilled in the art, the present invention applies equally 
well to any set of hierarchical data structures. 

In the preferred embodiment of the present invention, the 
hierarchy of an XML document is viewed as an inverted 
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tree where each node represents an element of the data 
structure, where the root is the parent of the nodes at 
the next level, and so on. The rank of a node is its tree 
level. To each node is assigned an identity that is a 
function of node_s rank, the node order among its 
siblings and the node_s data content. A description of 
the method of determining identity follows later in this 
disclosure. A differencing tree is a tree with its 
identity on a node. 

Comparison of structures becomes now a comparison of 
differencing trees, by concurrently walking the trees 
performing a match and compare algorithm to find 
differences between two such trees. The comparison 
produces a third tree, representing a merging of the 
initial two structures. In this merged structure, nodes 
are tagged relative to the first (base) structure and can 
be of the following types: unchanged, new, removed or 
changed. The new, removed and changed nodes are also 
called unresolved nodes. 

1) Unchanged node: a node with the same identity 
in both trees, representing identical data in both 
structures; 

2) New node: a node whose identity cannot be found 
in the first tree; the data it represents only appears in 
the second structure; 

3) Removed node: a node whose identity cannot be 
found in the second tree; the data it represents only 
appears in the first structure; and 
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4) Changed node: a node with the same identity in 

both trees, having data that is different between the two 
structures. 

Note that if a node is new, removed or changed, then its 
parent (and its parent, and so on up the hierarchy) is 
unresolved. 

The second part of the comparison process is the merging 
of differences. This is accomplished by the user 
selecting nodes that -show differences (i.e. nodes that 
are tagged as new, removed or changed) . The goal is to 
resolve differences at each changed, new, or removed 
node, by choosing to select data from either of the two 
structures being compared, and incorporating the selected 
data into a merged structure. In this context, a user can 
equally be a human operator, another software tool, a 
hardware device or any other means for providing the 
input required for the invention including the selection 
of nodes and/or the provision of the structures. 

When the user makes a decision as to whether to include 
or exclude an unresolved node in the hierarchy of the 
merged structure, changes are propagated down to the 
child nodes, as if a similar decision has been made on 
each child node in the substructure. This propagation is 
also sent up the hierarchy to all the parents of the 
current node, so that when the parent has no unresolved 
children then the parent becomes resolved, and then the 
same procedure applies to the parent of" the parent, and 
so on. 
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Referring now to Figure 1, a user has edited a base file 
named _PersonFile.xml_, having base file structure tree 
10. The editing created a modified file named 
PersonFilel .XML, having modified file structure tree 20. 
The editing involved removing the attribute __address_ 12 
and changing the _type_ 14 of element _age_ 16 from long 
to short (not shown) . 

Figure 1 illustrates the trees representing the structure 
of the two XML files. Note that not all of the data is 
explicitly shown, but rather only the node structure. 

After determining the differences between base file 
structure tree 10 and modified file structure tree 20, 
the resulting new tree is shown in Figure 2 as merged 
file structure tree 30. The unresolved nodes have a 
crossbar (an X) . The nodes without the NEW (not shown) , 
CHANGED , or REMOVED indicators are unchanged. An XML file 
contains a plurality of elements that can be equated to a 
node in a tree. Each node or element may have zero or 
more elements. Thus the XML statement <Attribute type = 
_integer__> defines an element named _attribute_ having a 
single attribute, named _type_. The value of the 
attribute _type_ is _integer_. As can be 'seen in Figure 
2, removal of the attribute _address_ is shown by 
crossbars next to the <Attribute Name=address> node arid 
its child nodes along with an indication that those nodes 
are _REMOVED__. Crossbars are also propagated to the 
parent nodes to indicate that those nodes are unresolved 
because a child node - in this case, the * <Attribute 
Name=address> node - is unresolved. Further, the change 
of _type_ of element _age_ from long to short is shown by 
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a crossbar next to the <Type> node underneath the 
<Attribute Name=age> node along with an indication that 
that node is _CHANGED_. Crossbars are also propagated to 
the parent nodes of that <Type> node to indicate that 
those parent nodes are unresolved also because a child 
node is unresolved (although such a propagation is 
redundant in this case due to the previous propagation) . 

The simplest usage of the preferred embodiment of the 
present invention is to visualize the differences between 
the structure of two XML files, as illustrated in the 
merged file structure tree 30. However, the most useful 
feature is to merge the differences into a new XML file 
as directed by the user. 

The preferred embodiment of the present invention does 
not function at file level, but rather at a higher level, 
the XML element level. The invention displays a _merged_ 
tree, in which all the elements of the two input files 
are shown in a hierarchical tree display with the 
modified nodes tagged appropriately. For example, if an 
interface had one attribute in the first, XML file, but 
there is a new attribute added in the second file, the 
interface node would be marked as changed, and it will 
contain two child nodes, one for each attribute, with one 
node being unchanged, and the other marked as new. The 
user may then traverse the changed nodes and make a 
decision whether the change should be picked from the 
base file or from the modified file. Each node in the 
tree will have an associated pop-up menu (the menu bar 
can also be used) to allow the user to perform the 
desired action. The changes will be automatically 



CA998-052 



-12- 



12991. EWG 

ag\g:\105\12991\SPEC\12991.EWG 



propagated up and down the tree, so that the user won_t 
need to individually go to each node if a global decision 
can be made. For example, if a new node was selected as 
to be part of the merged file, then all its children will 
also be in the merged file; in addition, if this was the 
only node with a conflict under its parent, then the 
parent would be marked as resolved, and so on. The user 
has also the ability to undo repeatedly, to the last time 
the work was saved. 

Figure 3 is a screen capture of a user interface 
illustrating the merged file structure tree of Figure 2, 
as well as portions of the base file structure tree and 
modified file structure tree of Figure 1. In the left 
pane of Figure 3, the merged file structure tree 30 
contains the differences in the XML elements of base file 
structure tree 10 and modified file structure tree 20, as 
determined by a comparison of the base file structure 
tree 10 to the modified file structure tree 20. In the 
preferred embodiment the removed nodes are colored in 
red, the changed nodes in magenta and the new nodes in 
blue. Everything else is black. All the modified nodes 
receive a crossbar X as a node icon. After the user 
decides on which version of the node contents to select, 
the crossbar is replaced by a blue checkmark. Nodes with 
checkmarks (e.g. UUID node 31) will no longer have the 
pop-up menu available. The user can undo* the changes at 
any time. Optionally, the user can selectively undo 
certain changes. 

The right panes of Figure 3 show the content of a XML 
node selected from the left pane, in this case the 
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content of the element _age_ 16. The top "pane 4 0 displays 
the content of the element _age_ 16 as it appears in the 
source code of the base file, the bottom pane 50 is for 
the same element in the modified file. As shown base 
attribute 42 in top pane 40 has a type of short, while 
modified attribute 52 has a type of long. Both tags 42 
and 52 are part of element _age_ 16 and have different 
values, thus the reason for the crossbar X, and 
highlighting of changed type attribute 32 in merged file 
structure tree 30. When the node selected is a new or 
deleted node, only one of the two panes will have 
content. 

When the user exits the application (or at any time when 
clicking on the save button/menu item) the merged changes 
are written to a specified XML file. Changes that were 
not resolved (i.e. nodes with an X) will be resolved as 
in the base file. 

Once the user has a display of the combined XML files as 
shown in merged file structure tree 30 of Figure 3, the 
user may traverse the changed nodes and decide whether 
the change should be incorporated in a new merged file 
from either the base file, or the modified file. 

Every modified node in the merged file structure tree 30 
has an associated pop -up menu 34, that provides choices 
that enable the user to implement the decision whether to 
incorporate properties from either the base file, or the 
modified file. 

A new node has the following pop-up menu choices: 
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1) Do not use new: the new node is not 
incorporated in the merged file; and 

2) Use new element: the merged file incorporates 
the new node, and its children, if any/ as they are in 
the modified file. 

A removed node (e.g. removed node 36) has the following 
pop-up menu choices: 

1) Do not delete: the merged file incorporates the 
node as it exists in the base file; and • 

2) Delete from base file: the merged file does not 
incorporate the node that was deleted from the base file. 

A changed node (e.g. element _age_ 16) has the following 
pop -up menu choices: 

1) Use old, where conflict: the merged file 
incorporates the node as it exists in the base file for 
the current node, and any of its unresolved children 
(those modified child nodes for which the user has not 
made a decision about incorporation in the merged file 
yet) ; and 

2) Use new, where conflict: the merged file 
incorporates the node as it exists in the modified file 
for the current node, and any of its unresolved children. 

The above listed choices are also available from the 
Selected menu. 
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To merge the two XML files, the user executes the 
following steps: 

1) Select one of the highlighted nodes in the 
merged file structure tree 30. 

2) Select Use modified (new) file for node and 
unresolved children from the pop -up menu of the node if 
the user wants to have the merged file incorporate the 
changes that were made in the modified XML file. Select 
Use base (old) file for node and unresolved children from 
the pop -up menu of the node if the user wants to have the 
merged file have the older or base version of the 
corresponding node. 

3) Use Edit - Undo to undo all of the users 
actions up to the last time the user saved their work. 

When comparing XML files, the user selects the base and 
the modified XML files. Using an XML parser the two files 
are parsed and the two parse trees obtained. Each node in 
the tree corresponds to an element in the XML document. 

The two trees are being walked in parallel, starting from 
the root and at each level nodes are matched from the two 
trees and added to a merged tree (or comparison tree) and 
tagged appropriately (new, removed, changed, same) . 

The identity function is based on the node_s position in 
the tree, its ID attributes or its direct content. The 
identity function can be anything the user wants and can 
be customized. In the preferred embodiment of the present 
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invention, the identity function is designed to uniquely 
identify XML elements. The tool determines the identity 
of a node by examining certain attributes in the 
following manner. 

A tree (representing an XML file structure) is a tree of 
XML elements, each element having zero or more 
attributes. Firstly, all the attributes of an element are 
examined to determine whether there is any attribute of 
type ID. XML defines a type ID for an attribute and a 
valid XML document should enforce that no two elements 
have attributes with the same ID, i.e. the values of the 
ID attributes must be unique in an XML document. If such 
an ID attribute is found, then the identity is the value 
of the attribute (guaranteed to be unique in that 
document). If, there is no ID attribute, the direct 
children of this node are examined and checked to 
determine whether there is one with a tag called <Uuid>. 
If one is found, then its value is taken (i.e. the text 
content of the Uuid element, which is an Open Software 
Foundation's Distributed Computing Environment (DCE) 
compliant universally unique identifier) and used as the 
node identity. 

If none of the above is successful, look for an attribute 
of the element represented by the node with a name equal 
to __Name_. If one is found, use it as the node identity. 

Last, if none of the above steps provide a node identity, 
then take the text contained within this element, and 
concatenate it with the element tag and use it as the 
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identity of the node. The tag is the name of the element 
e.g. in <Title>My Book</Title> / the tag name is _Title_. 

To allow for different ordering of nodes within a level, 
the dependency of the order among siblings may be ignored 
in identity, in which case an assumption is made that the 
node_s data is different among sibling .nodes . 
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The following algorithm is used to construct the merged 
file structure tree 30: 
Rootl = root of the base tree 
Root2 = root of the modified tree 
Root3 = new root for merged tree 

Compare (rootl, root2, root3) : 

For each child of rootl { 

If there is no child of root2 with the same 
identity then add this child to root3 and 
tag it as REMOVED. 

Then add the whole subtree rooted at this 
child to the merged tree and mark all the 
nodes as REMOVED (since their parent node 
was removed) . 

} Else { 

If there is a child of root2 with same identity 

then check the content of the two child 
nodes (XML attributes and text) . 
If there are differences, 

mark the rootl child node as changed 
(i.e.. children changed) and add it to the 
merged tree. 

} 

} 

Once all the children of the rootl have been examined the 
roles are reversed and each child of root2 is examined to 
determine if it appears as a child of the rootl node 
(i.e. rootl has a child with the same identity) . Those 
that are not found are marked as NEW and added to the 
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merged tree. Also, the subtrees rooted at these nodes are 
added (and tagged as NEW) to the merged tree. 

When all the children of rootl and root2 have been 
5 examined, the trees are recursively traversed using the 

same process to ensure that any descendants that may have 
been changed, removed or new are also identified. 

The recursion algorithm is as follows: 

10 

For each childl of rootl 
,y For each child2 of root2 

|Tj For each node added in the merged tree 

-4 (caused by comparing childl and child2) 

IP 

^ 15 Compare (childl, child2, node) 

ifl 

; ! . Referring now to Figure 4, a schematic diagram 

U illustrating the components of the preferred embodiment 

If; of the present invention. The preferred embodiment of the 

Q 

(Pl 20 present invention shown generally as 60 comprises a main 

=0 tool 62 which coordinates the comparison and display of 

the input files 64. Main tool 62 first passes each of the 
two input files 64 to the XML parser 66. As recognized by 
one skilled in the art, the use of the XML parser 66 is 
25 based solely upon the fact that for the purposes of this 

embodiment the input files 64 comprise XML source code. 
The XML parser 66 produces as output a parse tree 68 for 
each of the input files 64. Once the parsing of the input 
files 64 is completed, the main tool 62 invokes the 
30 comparison module 7 0 to compare the contents of the parse 

trees 68. The comparison module 70 then -creates a merged 
tree 72 combining the elements of the two parse trees 68. 



CA998-052 



12991.EWG 

ag\g:\105\12991\SPEC\12991.EWG 



The tree view module 74 then displays the merged tree 72 
in the format illustrated in Figure 3. -The user 76 then 
interacts with the tree view 74 as shown .in Figure 3 to 
determine which elements of the merged tree 72 are to be 
selected to create the output merged file 78. As is 
readily apparent to those skilled in the art, any or all 
of these components may be integrated into one tool or 
may each be separate tools that are interconnected or 
stand-alone. 

The XML parser 66 has a digest function which encodes all 
of the information about an XML element and all of its 
descendants. This digest function can be used to 
determine whether two elements are identical or not. This 
aids in identifying changed elements even though they 
appear to be the same when their attributes are initially 
examined. As discussed, a changed node is caused by 

« 

either changes to the attributes of an element or changes 
to one of its descendants. Thus, although a change will 
always be identified, the ability to recognize a change 
at a higher level of the tree allows an element to be 
identified as changed at that point. 

The invention may be implemented on a stand-alone basis, 
integrated into an application wherein the invention is a 
feature such as an integrated software development 
environment or integrated into an application to further 
process the results of the analysis and/or provide the 
variable inputs including the trees to be analyzed or the 
decisions on whether to incorporate into a merged file 
element (s) from the base file or from the modified file. 
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The invention may be implemented as a program storage 
device readable by a data processing system, tangibly 
embodying a program of instructions, executable by said 
data processing system to perform the method steps of the 
invention. Such a program storage device may include 
diskettes, optical discs, tapes, CD-ROMS, hard drives, 
memory including ROM or RAM, computer tapes or other 
storage media capable of storing a computer program. 

The invention may also be implemented in' a computer 
system. In a preferred embodiment, a system is provided 
comprising a computer program operating on a data 
processing system, with the computer program embodying 
the method of the invention and producing an output of 
the method on a display or output device. Data processing 
systems include computers, computer networks, embedded 
systems and other systems capable of executing a computer 
program. A computer includes a processor and a memory 
device and optionally, a storage device, a video display 
and/or an input device. Computers may equally be in 
stand-alone form (such as the traditional desktop 
personal computer) or integrated into another apparatus 
(such as a cellular telephone) . 

While the invention has been particularly shown and 
described with respect to preferred embodiments thereof, 
it will be understood by those skilled in the art that 
the foregoing and other changes in form and details may 
be made therein without departing from the spirit and 
scope of the invention. 
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